Solomonoff Prediction and Occam’s Razor
نویسندگان
چکیده
Algorithmic information theory gives an idealized notion of compressibility, that is often presented as an objective measure of simplicity. It is suggested at times that Solomonoff prediction, or algorithmic information theory in a predictive setting, can deliver an argument to justify Occam’s razor. This paper explicates the relevant argument, and, by converting it into a Bayesian framework, reveals why it has no such justificatory force. The supposed simplicity concept is better perceived as a specific inductive assumption, the assumption of effectiveness. It is this assumption that is the characterizing element of Solomonoff prediction, and wherein its philosophical interest lies.
منابع مشابه
A Syntactic Approach to Prediction
A central question in the empirical sciences is; given a body of data how do we best attempt to make predictions? There are subtle differences between current approaches which include Minimum Message Length (MML) and Solomonoff’s theory of induction [24]. The nature of hypothesis spaces is explored and we observe a correlation between the complexity of a function and the frequency with which it...
متن کاملOptimality of Universal Bayesian Sequence Prediction
Various optimality properties of universal sequence prediction based on Bayesmixtures in general, and Solomonoff’s prediction scheme in particular will be studied. The probability of observing xt at time t, given past observations x1...xt−1 can be computed with Bayes’ rule if the true generating distribution μ of the sequences x1x2x3... is known. If μ is unknown, but known to belong to a classM...
متن کاملOptimality of Universal Bayesian Sequence Prediction for General Loss and Alphabet
Various optimality properties of universal sequence predictors based on Bayes-mixtures in general, and Solomonoff’s prediction scheme in particular, will be studied. The probability of observing xt at time t, given past observations x1...xt−1 can be computed with the chain rule if the true generating distribution μ of the sequences x1x2x3... is known. If μ is unknown, but known to belong to a c...
متن کاملAn Open Problem Regarding the Convergence of Universal A Priori Probability
Solomonoff unified Occam’s razor and Epicurus’ principle of multiple explanations to one elegant, formal, universal theory of inductive inference, which initiated the field of algorithmic information theory. His central result is that the posterior of his universal semimeasure M converges rapidly to the true sequence generating posterior μ, if the latter is computable. Hence, M is eligible as a...
متن کاملOn generalized computable universal priors and their convergence
Solomonoff unified Occam’s razor and Epicurus’ principle of multiple explanations to one elegant, formal, universal theory of inductive inference, which initiated the field of algorithmic information theory. His central result is that the posterior of the universal semimeasure M converges rapidly to the true sequence generating posterior μ, if the latter is computable. Hence, M is eligible as a...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2016